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Multi-Modal  Communication 


[1.5  03  i-SJDiiLiti:  tM  stan  6  groups  p oup  BULL  SE  YE  0  *  4f54,  34000  back  fecnitb horiile  group  BULL 5EYE 
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Spatial  Audio 


Spatializing  communication  into  virtual  locations 
increases  intelligibility  by  30  -  40%  as  well  as  reduces 
listener’s  perceived  mental  workload 


~Jp|*l 


Vo  |  AULj 


Mum 


Isolate 


Replay 


Talk 


Mytfi.y.Mi  u..  bravo  2- 1  tHeb  u  xu  |,u  5-7  mariung  rcund  over 
W5  35]Ic*b«E  5-7-2- 1  mark  owl 
[l  >  04  4B|Hjvoc  ^nd  iuv«sb«  victor  ^41.7.0444.0  over 
Flay  Stop  Rev  lie  A-nnnUfe  P>  I* 

[I  5  0-1-5  l]IooboK:  2-!  copies  gt id  c a vera ber ■  i ldor  3 -0-7 -0-3 -4- 5-0  on! 

[I  S,05.02]Kjvqc  15  round  wilkc  pete  ai  my  command  request  time  of  flight  max  ord  over 

[15  05  07  jieebox  2-1  copies  mark  mg  rmd  Willi*  pete  at  my  command  request  tntie  of  flight  max  ofd  authenticate 

alpha-bravo  over 

1 1  5:05: 30  (Havoc  engage  chit  be  out 

f  1 5  06: 3  2 jlcebox  sulu  5-7  bravo  2-5  with  message  to  observer 

[  I  5:06:4 1  ]  Havoc  *■*  ahead 

[I  5  06  54|Icebos  bravo  2-5  passes  alpha  battery  immediate  suppression  in  effect  target  number  alpha- foxtrot  1-0-  1-0 
lime  of  flight  5-9  $eC4a4i  max  ord  7000  feel  eve? 

[I  5:07:11  jHavoc  alpha  battery  immediate  suppression  tn  effect  target  number  alpha  foxtrot  I -0-1-0  time  of  flight  5.9 
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Capture  and  Display  of 
Radio  Messages 


Real-time  speech-to-text  transcription  of  radio  messages 
Audio  files  are  recorded  and  linked  to  transcription 

—  Messages  can  be  replayed  in  faster  then  real  time 

Messages  are  timestamp 


[1]  radio450000000  -  450  MHz 


Play 


Stop 


Revise 


Annotate 


Tags:  WL 


1 1 1  ■ 1 


A-  AT  R  X 


Keywords 


On 


IVol.  Asj. 


Isolate 


[20:40:54]Gowboy3: 
[20 :41 :Q0]Go  wboy  1 : 
[20:41:09]Gowboyl: 
[20:41:16]Gowboy2: 
[20:41: 24]Go  wboy3: 
[20:41: 28]Cowboy2 : 
[20 :41 :33]Go  wboy2: 
[20 :41 :4i]Co  wboy  1 : 
[20:41: 52]Go  wboy2: 
[20:42:07]Gowboyl: 
east 

[20:42: 17]Gd  wboy2: 
trailer 

[20:42: 18]Go  wboy  1 : 
[20 :42: 27]Go  wboy  1 : 
[20:42:34]Gowboy2: 
[20:42:39]Cowboyl: 
[20:42:4S]Cowboy3: 
[20:42: 53]Go  wboy  1 : 


cowboy-03  passing 
cowboy-01  and  2  jettison 

cleared  group  BULLS  EYE  0-5-0  /15  28 ,000  track  east  bogey 

cowboy-02  lead  group  2  miles  line  abreast  tracking  east 

airedale  target  lead  group  3  and  4  and  uh  freeze  you  up  and  reload  you 

cowboy-02  say  0-  aspect 

cowboy-02  show  1-6  left 

cawboy-Ql  dheck  that  14  left  lead  group 

cowboy-02  drop  lead  group  target  trail  group  BULLS  EYE  0-4-6  /16  24 ,000  bogey 
cowboy-02  ID  the  group  BULLSEYE  0-  6-  0  /20  can  re-form  SB  ,000  HOSS  COWBOY  track 

cowboy-02  targeted  trail  group  BULLSEYE  0-  4-  conans  out  /13  24 ,000  sorted  northern 

cawboy-Ql 

cawboy-01's  egress  3-  0-  5-0 
cawboy-02's  dropped  lead  group 

cawboy-01  that  bandsaw  right  third  cowboy-02  Ian  right  too 
cowboy-03  come  left 
cowboy-01's  tally  threat 
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Text-Chat 


•  Sends  and  receives  Chat  messages 

•  Chat  input  via  typing  or  speech-to-text  (STT) 

•  Chat  messages  can  be  heard  with  text-to-speech  (TTS) 


a-  m  r  * 


[19:05:54]ron51:  Cowboy  3-  Cowboy  three 
Cowboy  2-  Cowboy  two  sort  northern  trailer 

Cowboy  2-  Cowboy  two  sorted  northern  trailer  and  three  you  can  ^tart  left  bum  badk  sbeeipoimt  two  Cowboy  two 
fan  light  Cowboy  one  engaged  bullseye  zero  seven  nine  twenty  nine  disregard  zero  six  zero  twenty  seven  twenty 
four  thousand  bogey 
Cowboy  1-  Cowboy  one  is  tally  leaders 

Cowboy  2-  Cowboy  two  is  tally  four  ship  offset  container  sorted  northern  trailer 

Cowboy  1-  Cowboy  one  id  hostile 

Cowboy  2-  Cowboy  two  fox  three  northern  trailer 

Cowboy  1-  Cowboy  one  fox  two  southern  trailer 

Cowboy  2-  Cowboy  two  fox  two  southern  trailer  sorted  northern  leader 

Cowboy  2-  Cowboy  two  press 

Cowboy  2-  Cowboy  two's  out  of  range  northern  leader  nose  four  miles  track!  n  east 
Cowboy  1-  Cowboy  one  and  two  egress  one  five  zero 
Cowboy  1-  Cowboy  one 

Cowboy  2-  Cowboy  two  standby  for  one  and  two  this  is  mission  terminate  terminate  you’re  cleared  east 
Cowboy  3-  Cowboy  three  gate 

Cowboy  3-  Cowboy  three  and  four  you’re  cleared  down  track  urn  i’m  going  to  hold  the  threats  until  you  get  to 
steer  two  mark  event  they're  comin  off  freeze  ready  ready  now  they're  cleared  on  track 
Cowboy  3-  Cowboy  three  cobra  picture  single  group  disregard  two  groups  range  five  leaders  bullseye  zero  four 
zero  ten  twenty  four  thousand  track  east  bogey 

Cowboy  3-  Cowboy  three  target  group  bullseye  zero  three  two  ten  four  targeted  twenty  four  thousand  bogey 
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Edit  /  Annotate  Messages 


radia450000000  -  450  MHz 


*  ASR  is  not  100%  accurate 

*  Messages  can  be  edited  to 
reflect  the  correct 
information 

*  Text  can  be  formatted  to 
user's  preference 

*  Ability  to  copy  and  paste 


Operators  can  leave  notes 
to  themselves  for  later 
review  or  debriefings 


Rf  fb  fb  W 


QGSQQ 


[17:12:13]Cowboyl:  CONAN!  trail  group  BULLSEYE  0-  4-  0  /II  can  target  0-5-0  /1Z  conan-04 ,000  trade  east 
*  I  bogey 

17: 12 : 17lGawbov3 :  cowbay-01  and  2 

[17:12:28]Cowboy2:  cowboy-02  say  aspect  of  the  lead  group  back  0-  7-  0-1  and  2-1  conan-03's  up  and  reload 
ship 

(RT 17: 12"35lCawbov3:  cowboy-03  drop  lead  group  gimbal  airedale  target 


1,  cowboy-02  drop  lead  group  gimbal  airedale  target 
0,  cowlboy-03  drop  lead  group  gimbal  airedale  target 


r  17:12:45lCowboy3:  cowboy-03  target  bail  group  now  BULLSEYE  0-  5-  5  /28  4  ,000 


cowboy-03  target  trail  group  r*ow  BULLSEYE  0-  S-  b  f2S  4  r0UU 


[17:12:51]Gowboyl:  cowboy-01  sorted  ^nrthern  bailer 

[17:13:02]Gowboy3:  can  ^  =n  "  1  group  BULLSEYE  (L  6-  5  /2B  28  r0GC 

r'“ _ ^j^unuoy^:  cowboy-01  and  2  ^,iad<ie 

1 1 [17:13  :18]Gowboyl :  cowboy-03's  10  miles  power  hud 


I  Send 


■a dio 3 50000000  -  350  MHz 


j 


Arrotaie  I 


DEBBu 


[17:14:59]:  This  room  is  not  anonymous. 

[17:ll:07]Rambol  and  2:  cowboy-01  in-place  90  left  reference  2-  5-  5  BARNYARD  bogey  dope 
[17:ll:18]Bamyard:  CONAN  01  as  group  BRAA  2-5-5  /33  static  out  of  10 ,000  ho^ile  heavy  4  contacts 
ri7:ll:25]Rambol  and  2:  rambos  push 
Http:  ll:27ji§fnlSii±  BARNYARD 

[17:ll:55]Bamyardr  counter  are  3-  group  champagne  15  wide  fl  deep  weighted  south  north  lead  group 
BULLSEYE  0-  5-  4  /36  32  ,000  spades  heavy  4  contacts  line  abreast  3  cowboy-03  group  27 ,000  hostile  heavy  4 
contacts  line  abreast  5  trail  group  10 ,000  hostile  2  contacts 
[17:12:03]Rambol  and  2:  rambo-02  group  BULLSEYE  0-5-6  /3B  36  ,000  hostile 
ri7:12:13lBamvard:  cowbov-02  locked  north  lead  Group  hostile  heavy  4  contacts 


-r?or 

Vol,  Adj,  jl 

Mute 

Isolate 

Replay 

-■* 

[17:12:20]Rambol  and  2:  rambos  float  skate 
[17:12:24]Rambo3  and  4:  RAW  BO  0-  4-  strobes  south  lead  group 

[17:12:33]Rambol  and  2:  cowboy-02  45  miles  north  lead  group  BULLSEYE  0-5-  8  /42  36 ,000  hostile 


|  Sand 
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Accessing  Information 


Revise  I  Annotate  Tags: 


[20:34 

[20:34 

[20:34 

[20:34 

[20:34 

[20:34 

[20:35 

east 

[20:35 

trailer 

[20:35 

[20:35 

[20:35 


[>»] 

JTAC 

Tanker 

AW  ACS 

Fighters 

'Find'  function  allows 
operators  to  search 
for  specific  words  or 
phrases 


Flag  lines  of 
communication  for 
easy  retrieval 


'History'  goes  to 
particular  times 


Fins 


-i::or- 


TS  Or 


■■  k 


Keywords 


Find 

History 


5  Or 


Vol.  Asj 


-  l:= 


I :c  =  te 


Replay 


■=lk 


[3]  radio300000CI00  -  300  MHZ 

QQQQQQQQ  Previous  [Next]  All 

Keywords 


[20:26:58]Eagle3:  eagle-03's  10  miles 
[20:29:08lEaqle3:  eaqle-03's engaged  BULLSEYE  0-  6-  0  {22  24  r000  tally  4-4  tally  4 
[20:29:17]Eagle3:  eagle-03  ID  hostile  hostile  fox  2  northern  traiiler  fox  2-  southern  trailer 
[20:29:21]Eaglel:  eagle-01  and  2  hook  left  EM  sorted  BRAA  northern  leader 
[20:29:27]Eag!e3:  eagle-03  let's  off  flow  out  0-  9-  0 
[20:29:53]Eaglel: 


[20:29:57]Eaglel:  eagle-01  2  ship  below  a  yeah  that 
[20:3D:G4]Eaglel:  conans  /31  80  in  the  north  eagle-01 
[20:30:09]Eaglel  :  eagle-01  and  2  gate 
[20:30:12"l|=aglel  :  eagle-01  and  2  you're  deaned  down  trad? 

[20:3f>-Tcrir  A:  eagle-01  cobra  COIMAN  picture's  2  groups  range  12  leaders  are  BULLSEYE  0-  0-  3-  0  /10  28 ,00 
udCK  east 1  jgey 

[20:30:33]Eaglel  :  eagle-01  trailers  BULLSEYE  3-  0/1  5  /8  24 ,000  trade  east  bogey 

[20:30:40]Eagle2:  eagle-02  hits  lead  group  0-3-5  /12  20  ,000 

[20:30:41]Eaglel  :  eagle-01 

l^.Z"  ^^nlel:  eagle-01  and  2  offset  2-9-0 


[12]  radio450000000  -  450  MHz 


Play  Stop  Ravipe 


:ll]Gowboy2 

:18]Cowboy3 

:22]Gowboy2 

:27]Gowboy2 

:35]Cowboyl 

:46]Gowboy2 

:01]Cowboyl 


cow  boy- 02  lead  group  2  miles  line  abreast  tracking  east  |_J 

ai  reda  le  target  lead  group  3  and  4  and  uh  freeze  you  up  and  reload  you 
cow  boy- 02  say  0-  aspect  ! 

cowboy-02  show  1-6  left 


cowboy-02  drop  lead  group  target  trail  group  BULLSEYE  Q-  4-  6  /16  24 ,000  bogey 
cowboy-02  ID  the  group  BULLSEYE  0-6-0/20  can  reform  SB  ,000  HOSS  COWBOY  track 


i:10]Cowboy2:  cowboy-02  targeted?  trail  group  BULLSEYE  0-  4-  conans  out  /13  24 ,000  sorted  northern 


:12]Cowboyl: 

:21]Cowboyl: 

:24]Cowboy2: 

:34]Gowboyl: 

:42]Cowboy3: 

:47]Cowboyl: 

:51]Gowboy2: 

:58]Cowboyl: 

:Q2]Gowboy2: 

:14lGowbovl: 


cowboy-01 

cowboy-01's  egress  3-  0-  5-0 
cowboy-02's  dropped  lead  group 

cowboy-03  come  left 
cowboy-01's  tally  threat 
cowboy-02's  tally  2  ship  trail  group 
cowboy-01  hostile  hostile 
cowboy-02  fox-3  northern  trailer 

cow  bo v- 01  fox-2  southern  trailer  cowboy -03  0  /32  eaness  12-0- 
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Keyword 


User  defined  keywords  are 
highlighted 


Counts  number  of  messages 
since  channel  was  last  visited 


[18]  radio3GOOOOOOO  -  300  MHz 


Keywords 


I  History 


|TTS  On 
[vol.  Adj. 


Kute 


Isolate 


Replay 


[20:34:36]Eagle3: 

[20:34:45]Eagle2: 

[20:34:53]Eagte3: 

[20:35:03]Eagle3: 

[20:35 : 06]  Eagle  1 : 

[20:35:16]Eagle3: 

[20:35:21]Eagle3: 

[20:35:27]Eaglel: 

[20:35:38]Eagle3: 

[20:35 :41  ]  Eagle  1 : 

[20:35:47]Eagle3: 

[20:35:52]Eagle2: 

[20:35:58]Eagle3: 

[Z0:36:04]Eagle3: 

[20:36: 12]Eagie3: 

[20 : 36: 15]  Eagle  1 : 

[20:36: 19]  Eagle  1 : 

[20:36:31]Eaglel: 

east  bogey 

[20:36:42lEaqle3: 


eagle-01  and  2  gate 

eagle-02  say  aspect  of  the  lead  g,  "  track  0-  7-  O  want  bandsaw  2  untargeted  0  02 
hud  eagle-03  drop  lead  group  gimbai  cobra  uh  target 
eagle-03  target  trail  group  now  BULLSEYE  0-5-5/28  24 ,000 
eagle-01  sorted  northern  trailer 

cobra  targeted  leac  BULLS  EYE  -  5  /28  28  ,000  trade  east  bogey 

eagle-01  and  2  shackle 
eagle-03's  10  miles  power  hud  30 

eagle-03's  engaged  BULLSEYE  0-6-2  /25  24  ,000  tally  2-4  tally  2 
eagle-01  and  2  cross  turn 
eagle-03's  ID  hostile  hostile 
eagle-02  fox-2  northern  trailer 

eagle-03  fox  southern  trailer 

eagle-03's  out  east  below  20 

eagle-03  this  is  mission  terminate  you're  cleared  out  east 

eagle-01's  ready 

eagle-01  you're  cleared  on  track 

can  01  cobra-03  target  2-  groups  0  /10  15  north  group  BULLSEYE  0- 1-  0  /15  22 ,000  track 


hH 


eagle-01  and  2  offset  2-9-0  south  group  BULLSEYE  0-  7-  5  /7  28 ,000  track  east  bogey 


2  Ik 
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Multi-Modal  Communication 


Questions? 


Victor  S.  Finomore 
937-904-7123 

victor.finomore@wpafb.af.mil 
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